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LEXINGTON 


MASSACHUSETTS 


ABSTRACT 


A  linear  predictive  form  of  classifier  is  described  for 
the  sequential  discrimination  of  target  signatures.  The  class¬ 
ifier  implements  a  Generalized  Sequential  Probability  Ratio 
Test  (GSPRT)  which  allows  for  multiple  classes  of  target 
signatures.  Forms  of  the  classifier  for  both  noncoherent  and 
coherent  signatures  are  described.  Flow  charts  are  included 
for  convenience  of  implementation. 
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I.  INTRODUCTION 


An  earlier  report  [1]  and  an  associated  paper  [2]  described 
a  linear  predictive  form  of  a  two-class  sequential  classifier 
for  target  signature  data.  The  present  report  describes  exten¬ 
sions  of  that  sequential  classifier  to  multiple  classes  and  to 
coherent  signature  data.  The  new  results,  although  complete 
in  themselves,  draw  heavily  on  material  presented  in  the  other 
two  publications.  This  report,  therefore,  assumes  that  the 
reader  is  familiar  with  the  material  in  References  1  and  2. 

The  extensions  described  here  are  conceptually  straight¬ 
forward  and  have  already  been  cited  in  the  previous  publications. 
However,  results  are  presented  here  in  sufficient  detail  for 
immediate  implementation.  Section  II  describes  the  multiclass 
sequential  classifier  for  noncoherent  signatures  and  Section  III 
formulates  the  results  for  coherent  signatures.  Section  IV  is 
a  summary.  In  addition,  two  appendixes  are  included.  Appendix 
A  provides  background  material  on  complex  Gaussian  processes 
that  justifies  the  coherent  formulation  of  the  classifier. 
Appendix  B  suggests  a  further  extension  of  the  classifier  to  a 
class  of  nonstationary  signatures. 
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II.  MULTICLASS  SEQUENTIAL  CLASSIFIER 


A.  Statistical  Theory 

Multiclass  sequential  testing  -  The  multiclass  sequential 
classifier  is  based  on  the  generalized  sequential  probability 
ratio  test  (GSPRT)  due  to  Reed  [3]  and  represents  an  extension 
of  the  Wald  sequential  probability  ratio  test  (SPRT)  for  two 
hypotheses  [4],  In  the  context  of  target  classification  let 
represent  the  vector  consisting  of  a  set  of  k  consecutive 
returns  x ^ .  x^,  . ...x^  on  a  target  which  are  equally  spaced 
in  time.  Such  a  set  of  returns  is  called  a  target  signature . 
The  individual  returns  _x.j  are  in  general  vector  quantities 
since  the  sensor  may  measure  several  quantities  at  once 
(radars  may  be  dual  polarized  and  samples  may  be  taken 
in  multiple  gates,  optical  sensors  may  take  measurements 
in  several  spectral  bands,  etc.).  Let  p  ^  ( X ^ )  represent  the 
probability  density  function  under  the  hypothesis  that  a 
target  belongs  to  class  i.  Then  the  GSPRT  proceeds  by  suc¬ 
cessive  rejection  of  hypotheses  as  follows. 

Let  C  be  the  total  number  of  hypotheses  (classes) 
under  consideration  and  let  be  the  number  of  hypotheses 
that  have  not  been  rejected  before  k  returns.  Then  a  set 
of  generalized  likelihood  ratios  is  defined  by 
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xk(^-’  -  Pi«k>  /  mp.tSk)]^ 

j  not** 
rej  ected 

Vi  3  H^ej hypotheses  not  rejected}  (2.1) 

and  a  corresponding  set  of  thresholds  a£  is  selected  in 
a  manner  to  be  discussed  presently.  The  following  set 
of  tests  is  then  performed 


*k*--k-*  <  Ak  — *  reject  Fh 

That  is,  all  of  the  hypotheses  are  tested  and  a  given 
hypothesis  is  rejected  if  the  corresponding  generalized 
likelihood  ratio  is  less  than  its  threshold.  If  this 
procedure  results  in  only  one  unrejected  hypothesis, 
that  hypothesis  is  the  one  accepted.  Otherwise  another 
return  is  observed  and  the  procedure  is  repeated 

until  there  is  only  a  single  hypothesis  remaining. 

Reed  suggests  that  the  thresholds  for  the  multi  - 
class  sequential  test  be  computed  from  the  relation 


rejected  rejected 
l  ■#=  i 

i 3 H.ej hypotheses  not  rejected 


(2.3) 


where  e^  is  the  (desired)  probability  of  deciding  upon 
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hk  given  that  is  correct.  Observe  that  this  re¬ 


quires  recomputation  of  the  thresholds  after  each  re¬ 
jection  of  a  set  of  hypotheses.  Since,  except  in  the 
two -class  case,  the  GSPRT  does  not  have  any  known 
theoretically  optimal  properties,  in  practice  it  is  just 
as  reasonable  to  determine  the  initial  thresholds  from 
(2.3)  and  keep  the  thresholds  fixed  or  to  allow  the 
thresholds  to  decrease  in  a  prescribed  manner  with  the  number 
of  observations.  A  convenient  family  of  these  time-varying 
thresholds  is  given  by  [5] 


Ak  ‘  [4  To(1'I^T)rii]1  “‘V1 


(2. 


I  2  3  4  5  6  7  8  9  10  k  max 

k 

Fig.  2.1  -  Form  of  Time-Varying  Thresholds 


and  is  plotted  in  Fig.  2.1  for  two  values  of 
Time-varying  thresholds  tend  to  decrease  the  average 
number  of  returns  necessary  to  make  a  classification, 
but  otherwise  have  no  specific  advantages. 

Observe  that  neither  the  fixed  nor  the  time-varying 
thresholds  guarantee  that  a  decision  will  be  made  after 
a  finite  number  of  observations.  Thus  in  practical  ap¬ 
plications  it  is  necessary  to  truncate  the  test  after 
a  fixed  number  of  observations.  A  decision  can  then 
be  conveniently  made  by  the  principle  of  maximum  likeli¬ 
hood.  Hypothesis  is  chosen  where 

p  (X.  )  =  max  jp,  (X.)  |  (2.5) 

1  max  j  not  l  J  max) 

rejected 

Alternatively  a  Bayes  or  Neyman-Pearson  test  can  be 

formulated  involving  the  quantities  p. (X, )  ,  and  that 

1  max 

test  can  be  evaluated  to  make  the  classification  decision. 
Details  can  be  found  in  various  texts  in  engineering  and 
statistics  (see,  e .  g .,  Ref  s  .  6  and  7). 

Relations  to  two-class  sequential  testing  -  As  stated 
earlier,  the  GSPRT  is  an  extention  of  the  Wald  SPRT. 

The  SPRT  is  conventionally  stated  as 
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where 


W  - 


1-e 


A  = 


21 


12 


B 


21 

T^e 


12 


y  A  - ►  accept 

<  B  - ►  accept 


(2.6) 


(2.7) 


For  tests  involving  two  hypotheses  (C= 2) ,  the  GSPRT  and 
the  SPRT  are  equivalent  and  the  quantities  defining  them 
are  related  by 


and 


iktxk)  =  [xjcxk)]  -  [i/»J(xk)] 

a  =  !H2 

b-m2 


(2.8) 


(2.9) 


In  this  case  both  the  SPRT  and  the  GSPRT  satisfy  an  op¬ 
timality  condition.  In  particular  they  minimize  the 
average  number  of  returns  necessary  to  achieve  the 
specified  error  probabilities  e^  an^  e-^. 
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B.  Linear  Predictive  Formulation 

It  is  easy  to  show  (see  Ref.  1)  that  if  the  observations 
x  ^ ,  x  2 ,  X]<  are  zero  mean  and  jointly  Gaussian  then  the 

log  density  function  can  be  written  in  the  recursive  form 


where 


in  p(Xk)  -  In  P(Xk.j)  -  \k  -\ln  | Efc | 

'  2-k  '  Gk4-1  ’  ['Gk  ;  :]^k 


-  jnin2ir 

(2.10) 


(2.11) 


and  G^  and  are  matrix  parameters  derived  from  the 

covariance  matrix  of  X,  and  n  is  the  dimension  of  the  x. 

— k  —i . 

a  X 

The  quantity  *  Gk-k-l  *s  t^ie  °Pt:’-ina^  linear  estimate  of 
x^  given  ^  and  G^  is  the  matrix  of  prediction  coefficients 
that  produces  that  estimate.  The  quantity  e.  is  the  error  x.  -x,, 
in  the  estimate  and  E^  is  its  covariance  matrix.  Both  G^  and 
E^  are  computed  from  training  data  in  a  manner  to  be 
described  later.  If  the  observations  are  not  of  zero  mean 


then  a  simple  removal  of  the  mean  of  x^  and  X,  ^  in  (2.11) 
allows  for  the  representation  in  (2.10).  Under  conditions  of 
stationarity  the  classifier  matrix  parameters  G^  and  E^  for  large 
k  can  be  well  approximated  by  matrices  of  lower  order  p+1 
and  this  greatly  simplifies  the  classifier.  For  values  of 
k  greater  than  p+1,  only  the  last  p  returns  x^_p, 

are  used  to  form  the  estimate  x^.  The  selected  value  p 
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relates  to  the  modeling  of  target  signatures  as  a  multivariate 
autoregressive  process  and  is  beyond  the  scope  of  the  present 
discussion.  However  Refs-  8  and  9  give  approaches  to  and 
discussions  of  the  modeling  problem. 

Equations  (2.1),  (2.2),  (2.10),  and  (2.11)  specify  the 

classification  algorithm.  The  classifier  is  represented  as 

a  structured  flow  chart  in  Table  2.1  and  as  a  block  diagram 
in  Fig.  2.2.  In  the  f igure , (2 . 11)  is  realized  by  multichannel 

discrete- time  filters.  The  filters  are  time-varying  for 

k  £  p+1.  However,  for  k  >  p  +  1  the  filters  are  time-invariant 

and  have  impulse  response  of  finite  duration  p+1. 

The  multiclass  sequential  classifier  has  a  simple  intuitive 
explanation  which  follows  from  Fig.  2.2  and  the  equations  in 
Table  2.1.  A  signature  is  applied  to  all  branches  of  the 
classifier  simultaneously.  In  each  branch,  the  mean  of  the 
target  class  is  removed,  and  the  signature  is  fed  through 
a  linear  filter  which  produces  the  prediction  error  process 
£^.  The  terms  e,  E  £^  appearing  in  Table  2 . 1,  when  summed 
over  k  represent  a  normalized  energy  in  the  error  process. 

When  this  sum  (the  integrated  error)  for  a  given  branch  exceeds 
the  average  of  the  corresponding  sums  for  all  branches  by  a 
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ass  sequential  class 


predetermined  threshold*  the  class  represented  by  the  branch 
is  rejected.  This  procedure  continues  until  a  single  class 
remains  unpej ected. 


The  classifier  parameters  G^,  E^,  k  =  1,  2,  . ..,  p+1: 
are  most  efficiently  computed  from  the  matrix  covariance 
function  R(£)  =  ^x^xj^j  via  the  multiyariate  Levinson 


recursion  lio]  or  directly  from  training  data  using  various 

algorithms  (see,  e .  g .,  Ref . ,  11) .  **  The  formulas  involve  an 

auxiliary  matrix  parameter  r  (the  reflection  coefficient)  and 

a  set  of  backward  prediction  parameters  G^,  E^,  which  per¬ 
tain  to  the  problem  of  estimating  Xj  from  x  2 ,  ...jX^.  Although 


these  additional  parameters  are  not  used  in  the  classifier. 


they  must  nevertheless  be  carried  along  in  the  recursion  for 
the  classifier  parameters.  The  formulas  that  define  the 
multivariate  Levinson  recursion  are  as  follows. 


*For  purposes  of  this  intuitive  explanation  it  is  assumed  that 
the  terms  fcn|E|  and  nin  211  are  lumped  into  the  threshold. 

**2oth  methods  assume  stationarity .  A  less  efficient  method 
that  does  not  assume  stationarity  is  given  in  Ref.  1. 
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Gk  = 


o 

4. 

m  « 

I 

.  Gk-1  . 

Gk-1  J 

’Gk-1  ' 

4 

"Gk-1 

0 

I 

k-1 


k-1 


(2.12) 


where 


Fk  •CEj‘1)(RT(k)-GJTBk) 

T?  *E;1(RT(k)-GlTB.  )T 


(2.13) 


and 


Ek  Ek-1  '  rk-lEk-irk-l 


-  r+T  e  r+ 

ck  K-1  1 k-1  k-11 k-1 


(2.14) 


When  the  signature  returns  Xj  are  one -dimensional  (n=l) 
the  forward  and  backward  prediction  parameters  are  identi¬ 
cal  and  each  pair  of  equations  (2.12)  -  (2.14)  reduces  to  a 
single  equation.  The  resulting  three  equations  define  the 
usual  (univariate)  Levinson  recursion. 
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III.  MULTICLASS  SEQUENTIAL  CLASSIFIER  FOR  COHERENT  SIGNATURES 


A.  Motivation  for  the  Coherent  Form 


The  signature  measured  by  a  coherent  radar  can  be 
represented  by  a  complex  random  process.  Since  the  classifier 
developed  in  Section  II  allows  for  multidimensional 
observations,  the  real  and  imaginary  parts  of  the  complex 
process  can  be  represented  by  two  correlated  real  processes 
and  a  classifier  can  be  developed  on  that  basis.  However, 
the  complex  process  that  represents  a  radar  signature  is  the 
complex  envelope  of  a  real -valued  narrowband  process  at  the 
video  stage  of  a  radar  receiver.  If  this  signal  is  stationary 
then  the  usual  theory  for  complex  processes  can  be  applied 
to  the  signature.  This  allows  for  a  more  simple  and  elegant 
analysis  than  is  possible  by  treating  the  components  of  the 
signature  as  correlated  real  processes.  The  relations  between 
the  two  approaches  are  discussed  briefly  in  Appendix  A.  The 
topic  is  discussed  in  more  detail  in  several  references  [l2-14l. 

In  this  section  the  individual  coherent  measurements  are 


represented  by  vector  quantities  z,  =  * ^  +  j  where  x^  and 
y,  are  the  quadrature  components  of  the  signal.  We  hasten  to 

point  out  that  x^  as  used  here  does  not  represent  the  same 
quantity  used  in  Section  II  and  that  the  classifier  for  real 
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processes  cannot  be  considered  to  be  a  special  case  of  the 
classifier  for  coherent  processes. 


B .  Coherent  Form  of  the  Classifier 

Following  the  development  in  Section  II,  let  represent 
the  set  of  observations  z  ^ ,  ...»  £j{.  Then  (see  Appendix  A) 
the  joint  Gaussian  density  function  for  the  pairs  x ^ ,  x ^  , 

Y_2  >  •••»  x.k>  yk  completely  equivalent  to  the  complex  Gaussian 
density  function 


P(zk) 


-(Zk-?k )*K_1Czk-zk) 


(3.1) 


where  Z  =  £[z]  and  K  is  the  covariance  matrix  £[(Z_-Z)  (Z  Z)  ]  . 
Although  in  most  applications  the  complex  random  vector  will 
have  zero  mean  (see  discussion  in  Appendix  A)  we  include  the 
mean  here  for  the  sake  of  generality.  Then  paralleling  the 
development  in  Ref.  1  it  can  be  shown  that 


Jin  p(Zk)  =  Hn  PCZ^) 

where 


Jin  |  Ev  |  -  n  fcn  II 

(3.2) 


=  -k  Gk-k - 1 


(3.3) 
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where  and  Z£  represent  observations  after  removal  of  the 
mean,  and  and  are  derived  from  the  covariance  matrix  of 
the  observations  in  the  same  manner  as  they  are  for  the  non¬ 
coherent  case.  The  flow  chart  for  the  coherent  form  of  the 


classifier  is  given  in  Table  3.1.  Figure  2.1  and  the  inter¬ 
pretation  given  in  Section  II  still  applies  although  in  this 
case  the  filters  have  complex  coefficients. 

The  classifier  parameters  can  most  conveniently  be  com¬ 
puted  from  the  complex  form  of  the  multivariate  Levinson  re¬ 
cursion.  Since  the  relevant  equations  are  obtained  from 
(2.12)  -  (2.14)  by  merely  replacing  the  transpose  of  a  matrix 
by  its  transpose  conjugate,  those  equations  need  not  be 
repeated  here.  As  in  the  noncoherent  case,  if  the  signature 


returns 


z . 

-3 


are  one-dimensional  the  second  equation  in  each 


pair  of  (2.12)  -  (2.14)  is  redundant  and  can  be  eliminated. 


15 


TABLE  3.1 


STRUCTURED  FLOW  CHART  FOR  THE  COHERENT  FORM 
OF  THE  MULTICLASS  SEQUENTIAL  CLASSIFIER 


NO  DECISION.  CHOOSE  H.  SUCH  THAT  -lnp.(zk  )  *  min  j  NOT  REJECTED  I -Tnp^ 


IV.  SUMMARY 

This  report  described  a  multiclass  sequential  classifier 
for  signatures  of  targets  observed  by  a  radar  or  other  sensor. 
The  classifier  implementation  was  based  on  linear  predictive 
filtering  concepts.  A  two-class  version  of  this  classifier 
had  been  developed  earlier.  The  current  report  extends  the 
work  to  multiple  classes  and  to  coherent  signature  data. 


17 


APPENDIX  A 


COMPLEX  REPRESENTATION  FOR  STATIONARY  COHERENT  PROCESSES 
Define  an  n-dimensional  complex  vector  random  process 
£(t)  =  x(t)+j£(t)  where  x(t)  and  ^(t)  are  n-dimensional  real 
jointly  Gaussian  vector  random  processes.  Let  Z,X,  and  Y 
represent  the  nk-dimensional  vectors  formed  from  k  samples 
of  the  processes.  We  have 


Z  =  X  +  jY 
Define  also 


so  that 


z  =  £ 


(A.l) 

(A. 2) 

(A. 3) 


Then  it  follows  that  the  covariance  matrices  for  £  and  2  are 
respectively 


e-  cM) T]  - 


k  =  e 


f(Z-Z)  (Z-Z)*] 


x  "yJ 


u 

z. 

^*xy 

] 

2yx 

Zy  J 

rI  : 

=  Cl :  j  I] 

X  i 

i  ~  ■ 

1 

w 

• 

^  2«yx  *  ^xy^ 

(A. 4) 


xH 


'yj 


i 

ji 


(A.  5) 
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where  the  bar  over  the  variables  represents  the  mean  value. 
If  the  processes  x(t)  and  y(t)  are  the  quadrature  components 
of  a  narrowband  process 


V(t)  =  x(t)  cos  O)0t  +^ft)  s  in  u>ot_  (A. 6) 

as  in  the  case  of  a  radar  signal  then  z^(t)  represents  the 

complex  envelope  of  the  process.  If  the  process  v(t)  is 

stationary,  then  the  complex  envelope  £(t)  (i.e.,  both  x(t) 

and  ^(t)) must  have  zero  mean.  Further,  it  is  easy  to  show 

by  expanding  £[v(t  +  T)  vT(t)]  (see  e.g.,  Ref.  12)  that  if  v(t) 

is  stationary  then  x(t)  and  £(t)  must  be  jointly  stationary 

and  their  covariance  functions  must  satisfy  symmetry  conditions 

K  (t)=K  (r)and  K  (t )*-K  ft).  It  therefore  follows  that 
x  Y  xy  yx 

E/Iy 

y  (A. 7) 

z  =-z 

and  thus  (from  (A.  5))  that 

K  =  2£x  ♦  j2£yx  fA.SI 

Under  these  conditions  the  Hermitian  covariance  matrix  K 
provides  a  complete  description  of  the  vectors  X  and  Y 
with  respect  to  their  individual  second  moment  characteristics 
and  with  respect  to  their  cross  correlations.  Further,  the 
analysis  is  simpler  and  more  elegant  in  terms  of  the 


complex  representation  and  hypothesis  testing  such  as  that 
performed  by  the  sequential  classifier  can  be  more  efficient¬ 
ly  carried  out  by  treating  x(t)  and  y(t)  as  components  of  a 
stationary  complex  process. 

Since  in  many  practical  problems  the  complex  envelope 

z(t)  arising  from  a  radar  signal  will  have  random  phase, 
the  zero  mean  condition  is  not  a  severe  restriction.  If 
z^(t)  does  not  have  random  phase  the  process  v(t)  can  be  made 
stationary  (provided  that  conditions  (A.  7)  hold)  by  removing 
the  time-varying  function 

2  cos  wQt  +  X  sin  “pt  (A. 9) 

This  implies  that  a  phase  coherency  is  maintained  between 
the  transmitted  and  received  signals  in  such  a  way  that  x  and 
£  can  be  properly  associated  with  the  quadrature  components. 
Although  this  may  be  difficult  to  achieve  in  practice,  we 
shall  allow  for  a  non-zero  mean  of  the  complex  vector  Z  in 
order  to  maintain  generality. 

It  is  the  goal  of  the  following  to  show  that  if  condi¬ 
tions  (A. 7)  hold  then  the  multivariate  Gaussian  density  func¬ 
tion 

F*(t> - i -  e  (A.10) 

*•  2nk  1 

(2n)  2  IEI  2 
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is  completely  equivalent  to  the  complex  Gaussian  density 


function 


p7(z)  =  ~~hic — ; 
1  n  kik 


,-(Z-Z)*K_1(Z-Z) 


(A. 11) 


in  the  sense  that  is  if  Z  corresponds  to  g  then  p_(Z„)  = 

— o  1  — o  — o 

Pt  (.^n)  •  This  will  be  done  in  two  steps. 


£  v^o- 


First  observe  that  from  (A. 4)  and  fi..8)we  can  write 


: 


[:};]  *[*: J»]  ca. 1 2) 


By  using  (^.12)it  can  be  directly  verified  that 


£  -  2  Re  [  -!-j  K  [l  jt 


(A. 13) 


Thus  the  exponent  in(A.10)is 


-  f)  E  d-l)  =42Re  i  d-I)T]  [-jij  k'1 


■Re  (Z-Z)*K"'(Z-Z)  =  -(Z-Z)*K_1(Z-Z) 


CA.  14) 


(The  last  equality  follows  from  the  fact  that  K  is  Hermitian.) 
Secondly,  it  can  be  shown  that 


El  -  (|)2nk|K|2 


(A. 15) 
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which  implies  that  the  scale  factors  in  the  two  density 
functions  are  equal.  In  order  to  show  this,  observe  that 
the  determinant  of  K  can  be  expressed  as 
nk 

I K |  =  II  Xi  (A. 16) 

i  =  l 

where  A^  are  the  eigenvalues  of  K,  which  are  real  but  not 
necessarily  distinct.  Now  let  e  be  an  eigenvector  of  K  corres¬ 
ponding  to  an  eigenvalue  A.  We  shall  show  that  the  vectors 


and 


(A. 17) 


are  eigenvectors  of  E  both  corresponding  to  an  eigenvalue  A/2. 
(It  is  trivial  to  show  that  and  Pj  are  orthogonal.  Since 
eigenvectors  e^  corresponding  to  various  A^  are  orthogonal,  a 
straightforward  computation  shows  that  the  p^  and  Pj 
corresponding  to  different  eigenvalues  are  also  mutually 
orthogonal  and  thus  constitute  a  complete  set  of  eigenvectors 
for  E-) 
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That  .  1 7)  are  eigenvectors  can  be  shown  as  follows. 
From  (A.  12)  and  (A.  17)  we  have 


i 
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Since  £  has  two  identical  eigenvalues  for  every 
eigenvalue  of  K,  the  determinant  of  ]£  is  given  by 
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121  -jl  -(*) 


2nk [ K  t  2 


Thus  the  equivalence  of  C\.  10)  and  CV.  11)  is  shown. 
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APPENDIX  B 


EXTENSION  OF  THE  SEQUENTIAL  CLASSIFIER  TO 
A  CLASS  OF  NONSTATIONARY  SIGNATURES 

Let  6^  represent  the  series  of  terms  ,  e^,  . 
defined  in  (2.11).  It  is  obvious  from  (2.11)  that  the 
quantities  6^  and  X^  are  related  by  a  causal  linoar  transforma- 
ation  with  Jacobian  equal  to  one.  Thus  it  is  possible  to 
write 


px^-k^  pe 


(B.l) 


for  any  6^  corresponding  to  a  given  X^.  The  fact  that  the 
{£^}  are  uncorrelated  (see  Ref.  1  or  2)  allows  a  simple 
factorization  of  the  density  p^.  and  this  leads  directly  to 
the  representation  in  (2.10)  and  the  associated  classifier 
structure . 

While  strictly  speaking  the  classifier  developed  in 
Section  II  permits  classification  of  nonstationary  signatures, 
many  of  the  advantages  of  the  classifier  are  lost.  The  filters 
must  be  time-varying  and  in  general  have  an  impulse  response 
corresponding  to  the  maximum  length  signature  observed  (p  » k-l). 
The  Levinson  recursion  cannot  be  used  to  compute  the  class¬ 
ifier  parameters.  Further,  design  and  application  of  a  class- 
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ifier  under  nonstationary  conditions  generally  assumes  that 
the  classifier  will  be  applied  starting  at  some  exact  time 
epoch.  This  is  not  possible  in  most  practical  situations. 

Our  purpose  here  is  to  develop  a  classifier  structure 
for  classes  of  signatures  which  can  be  modeled  as  containing 
a  random  trend.  Such  signatures  frequently  occur  in  practice 
and  represent  a  form  of  temporal  nonstationarity  for  which  it 
is  not  necessary  (indeed  of  no  value)  to  know  the  time  epoch. 

An  example  derived  from  observation  of  a  satellite  is  shown  in 
Fig.  B.l(a).  In  spite  of  its  random  nature,  the  trend  can  be 
exploited  for  purposes  of  discrimination.  In  what  follows,  it 
will  be  shown  that  to  account  for  the  nonstationarity  requires 
only  a  simple  modification  to  the  classifiers  developed  in 
Sections  II  and  III. 

It  is  easy  to  show  that  a  linear  trend  in  a  set  of 
(otherwise  stationary)  data  can  be  removed  by  taking  difference 
Vx^  *  x^  -  Similarly  any  trend  that  can  be  represented 

by  a  polynomial  of  order  d  can  be  removed  by  taking  differences 
of  the  data  d  times.  Figure  B.l(b)  shows  the  data  of 
Fig.  B.l(a)  after  taking  second  differences.  Except  for  small 
intervals  at  the  nulls  of  the  original  signature  the 
differenced  data  exhibits  a  stationary  behavior.  The  resulting 
stationary  process  can  be  subjected  to  the  usual  processes  of 
linear  prediction  in  order  to  perform  the  discrimination. 


V2  RCS  (dBsm)  RCS  (dBsmi 


Fig.Bl.( 
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a-b)  Removal  of  the  trend  in  a  signature  by  differencing. 
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To  formalize  the  foregoing  statements  observe  that  if 


*  x^  -  j  then  the  set  of .  differences  are  related  to 

the  observations  by  the  linear  transformation 


”k 


I 

hi  I 
0  -I  I 


0 


o 


■I  I 


*k 


(B.2) 


Since  the  Jacobian  of  this  transformation  is  equal  to  one, 
we  have 


Px  <**>  ■  Pu«k>  <B-5> 

Thus  if  is  stationary  we  apply  the  arguments  in  the 
first  part  of  this  appendix  to  obtain  the  classifier  structure. 
Otherwise  higher  order  differences  are  taken  until  a  sta¬ 
tionary  process  is  approximated  and  then  the  linear  predic¬ 
tive  structure  is  applied.  In  the  case  of  a  class  of  signa¬ 
tures  with  polynomial  trend  of  order  d,  a  branch  in  the  class¬ 
ifier  structure  of  Fig.  2.2  is  replaced  by  the  branch  shown 
in  Fig.  B.2. 


Fig.  B.2  Branch  of  sequential  classifier  for  nonstationary 
signatures. 
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w 


The  fundamental  ideas  in  treating  this  class  of  non¬ 
stationary  signatures  are  derived  from  the  theory  of  ARIMA 
(autoregressive  integrated  moving  average)  models  in  time 
series  analysis  whereas  the  corresponding  ideas  for  stationary 
models  such  as  those  discussed  in  the  body  of  this  report  are 
derived  from  the  theory  of  AR  (autoregressive)  models.  For  a 
thorough  discussion  of  these  topics  see  Ref.  15. 
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